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Abstract 



The Interaction of Words and Graphic Symbols* 
Investigated via a Programed Sequence of Concept 
Formation Experiences Related to Vector Spaces. 

M. Daniel Smith 

A. Joyce Bolyard 

Earlham College 

Learning tasks were constructed In which no words were 
Involved. Each task represented one stage In a programed 
sequence* and each stage was presented to each S as a 
concept*format1 on problem. S constructed (drew) his 
response at all stages of the Initial sequence* and at 
some stages In later sequences. There were .five sequences* 
averaging eleven stages each; they treated vectors 
as operators* vector addition* scalar multiples* commuta* 
tivlty* and associativity of vectors. 

Data recorded for each stage were (1) number of exemplars 
to criterion (two correct responses)* (2) mean time 
per response^ and (3) mean accuracy of response. Per- 
formance of ten fifth grade Ss was compared with that 
of another ten who covered a similar sequence with word 
tasks added to each exemplar. Simultaneous and successive 
presentations were also Involved. 

For the first sequence of eleven stages* a trend analysis 
of data type (1) above Indicated that the trends for 
the wordless and wordal versions werd significantly 
different (.05). The wordal treatment differed from 
the non-wordal on data type (?) (”01 } , as did simul- 
taneous and successive treatments (.001). Trend 
differences were found on data type (2) for non-wordal- 
wordal (.01) and simultaneous-successive (.05). On 
data type (3) the wordal -ndn-wordal treatment difference 
was significant (.001). All differences favored non- 
wordal stimuli and successive presentation. 

On the second sequence of fifteen stages* similar diff- 
erences were demonstrated for Type (1) and Type (2) 

(no accuracy scores). There was also a significant diff- 
erence between the wordal and non-wordal treatments on 
Type (1) (.05), favoring non-wordal. 

On the last three sequences differences tended to become 
non-significant* with the exception of a wordal-non-wordal 
trend difference on Type (1) (.01) In the last sequence. 
These data were clouded by the dropping out of one* then 
two Ss from one treatment (non-wordal successive). 



/\ post^test was designed to yield data similar to those 
recorded during learning. It Involved seven tasks with 
four exemplars each, Ss responded to the first exemplar 
of each task, with feedback after each response; they 
were given the second exemplars. In different order, 
again with feedback, and then the third exemplars and 
so on. This test was administered two weeks after 
completion of learning, and again two months later. On 
the "Immediate" post-test there was a simultaneous- 
successive treatment difference on Type 0) (*10); no 
other differences appeared for this data type. For 
Type (2) there was a difference In trend for all treat- 
ments, and an Interaction (all ,01). All differences 
favored non-wordal stimuli and successive presentation. 

On the delayed post-test, for Type (1) there was a weak 
trend difference for wordal -non-wordal (.25), There 
was also a Type (2) difference In trend for Interaction 
of treatments (.25). 

Scores on the delayed post-test were generally better 
than corresponding scores on the Immediate post-test, 
and Ss generally took less time. On the two test tasks 
yielding accuracy scores, the accuracy of the simultaneous 
groups decreased while that of the successive groups 
Increased. Accuracy for non-wordal was superior on the 
Immediate, slinhtly Inferior on the delayed post-test. 
















GENERAL INTRODUCTION 



The Ipcliislon of this general Introduction Is prompted 
by the somewhat unique nature of this Investigation, and 
by difficulties experienced In the past In communicating 
Its various dimensions to other Investigators and Inter- 
ested persons. The Investigation relates to three major 
areas; programed Instruction, the teaching of mathematics 
and science, and basic research In concept formation. 



In the area of programed Instruction the Investigation 
deals with step-size, frame format, and more basically 
the problem of small-sample trial-and-revislon development 
(experiment analysis) versus large-sample comparlslons-of- 
treatments (experimental design); It also deals with 
problems of pre-testing and post-testing. 



In the area of research In mathematics teaching. It deals 
with the use of relatively sophisticated concepts In early 
grades. This Involves considerations of concept he1rarch1es^^ 
the Identification of means by which basic all-embracing 

adapted for use early In leari»ihg*sa tiat: 
jater learning may be more efficient and effective. It 
also deals with optimal learning sequences and Improved 
stimulus presentations, matters affecting conventional 
text construction and class-room teaching as well as pro- 
graming. 



In the area of research In concept formation. It adapts 
concept»atta1 nment procedures and language to a problem 
In applied teaching, and at the same time collects data 
relevant to basic problems Investigated In concept formation 
research (vdrbal vs. non-verbal stimuli, simultaneous vs. 
successive presentation). 



Further, Petal 1 s ; Originally a ”11near" program, the se» 
quence was turned Into a series of concept-form< 4 t 1 on tasks. 
Then* by setting a learning criterion at each stage. It 
became a ”by-pass1ng” procedure which returned a difficulty 
score (trials to criterion) for each student at each stage; 
this process adjusts the difficulty of the program to the 
Individual. Time-to-respond and accuracy-of-response 
also recorded. A post-testing procedure was designed wn?cn 
gives a relearning score comparable to difficulty scores 
gathered during original learning. To analyze data, a 
trend analysis was employed which yields significant treat- 
ment differences over groups of stages. In spite of the 
small N typical of programing research. 



also 



The program Itself Is a sequence of learning tasks which 
Introduces the subject of vector spaces. A unique feature 
of this Investigation 1$ Us use of stimuli which have no 
words: such stimuli are termed ''non-wordal". Initial 

Investigations Into the feasibility of such sequences showed 
that they enabled one to Include a number of other features 
which conventional frames cannot encompass, among them the 
concept-attainment approach, the recording of a difficulty 
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score at each stage* and others described above. Words 
were added to the oon-wordal stimuli, thus treatment to 
gain some Indication of the Interaction of the two types 
of stimuli, 

^ The learning tasks feature the use of a two dimensional arrow 
as a representation of a vector, and a dot placed somewhere 
in the vicinity representing a portion of the space operated 
on by the vector* To treat the vector as an operator. It 
5®c®ssary to convey the Idea of Initial and final states 
lof the space, as represented by the dot). To do thls^ X 
would present S with a problem frame (a square of paper with 
the stimulus thereon), and then would present him with a 

frame”; here the point, which was originally 
solid, would be represented by a hollow dotted circle. After 
S had a chance to respond (ordinarily he could not do so 
on the first frame) he was presented with the "answer frame"; 
tnis gave him the new position of the point as well as the 
old position. The whole process conveyed the concept of 
initial and final states. The success of this approach was 
partially demonstrated at a later stage, where S$ were able 
to add vectors In the space of a few trials, by being olven 
the problem of two vectors acting on one point. Thus forming 
an additional treatment. 



REPORT OF RESEARCH 



A seqyence of learning tasks employing a relatively -sophisti- 
cated mathematical approach to vectors and vector spaces was 
constructed wlthoiiit using words. The feasibility of teaching 
via such non-wordal stimuli was demonstrated, using fourth and 
fifth graders In an Individual laboratory setting, and then 
field tested with modest success In a public school classroom 
(IS). Subsequently, wordal tasks were designed to be added 
to the frames In order to Investigate their Interaction with 
the non-wordal stimuli: Samples of the non-wordal and wordal 

tasks are shown In Figure 1. 

The use of the term “non-wordal” Is based on an analysis of 
verbal learning by Skinner (14), who treats as i«erba1 all 
behavior whose reinforcement Is contingent upon the resulting 
behavior of another. Using this analysis, graphical stimuli 
such as vectors and mathematical symbols are “verbal”. Thus 
the stimuli used In this study must be classed as either 
"wordal" or "non-wordal”, since both are verbal. 

There 1r some research related to the Interaction of wordal 
(verbal) and non-wordal (non-verbal) stimuli. Wittrock and 
Kelslar (19) Investigated the effect of verbal cues chosen 
from an Intuitively established hierarchy, and found that 
levels within this hierarchy differed In effectiveness. They 
did not order their concepts sequentially, as was done In 
the present study, nor did they use non-wordal stimuli except 
In tests of* transfer. Runquist and Hutt (12) and Johnson 
and O'Reilly (7) studied the comparative effects of pictorial 
and verbal stimuli In concept formation, and In each case 
the verbal (here “wordal”) version was more effective; again 
there was no sequential development of concepts, un the other 
hand, developmental research In programed Instruction by 
Holland (13) and Hively and Porter (6) evidence successful 
Intuitive use of non-wordal sequences* Furthermore, lon- 
wordal approaches to teaching have been used by such innovators 
In the teaching of mathematics as Beberman (1) and Suppes (16). 
There also seems to be a relationship between non-wordal 
(wordless) stimuli as used here and “meaningless” verbal 
learning stimuli used In research reported by Postman (11), 
where results Implied that “meaningless” material Is re- 
tained as well as “meaningful” material, given that they 
are learned to the same criterion (there was even a hint th^'t 
meaningless material may be retained better under certain 
circumstances )• 






I 









■• •;.-. .'-'j" -•■'./ . .; '.’"V'' . ; ,( .:,vr. -. ,. . ,,_ 






1 



I 







One objective of this research. In addition to Investigating 
the Interaction of words and non»i*orda1 stlimiull, was to form 
a sequence of tasks that would be "well-ordered" In that 
It would represent an optimal use of student energy In 
achieving understanding of the concepts and processes Invol- 
ved. It was assumed that to do this, a sequence would have to 
be both ’challenging" and capable of reinforcing “discovery" 
behavior* To achieve this, the step-size" of the programed 
sequence was made (Intuitively) fairly large, and then a 
number of similar tasks were developed at each stage ( stage 
here corresponds to ths conventional "step" In programing 
Jargon)* Each S was allowed to move to the next stage as soon 
as he reached criterion, which was two consecutive correct 
responses* Thus each stage became a concept-formation task, 
using con§(tructed responses* Since S passed to the next stage 
after reaching criterion, “branching" or "bypassing" was also 
Invol ved* 

The Intuitive process by which additional tasks were constructed 
for each stage can be described best In terms Identified with 
concept Identification research* Each of the tasks at a given 
stage had the same number of releant and Irrelevant dimensions 
but the Irrelevant ones were varied from task to task* The 
desirability of this approach Is suggested by the Investigations 
of Kurtz and Hovland (9) and Petersoti (10), which Imply that 
exemplars of a concept should be presented In succession, 
without other concepts Interspersed. The tasks at a given 
stage were not Inherently ordered as far as we could determine: 
they assumedly could be reordered wHhout changing the out- 
comes of the experiment, although some seemed more difficult 
than others as they were administered to Ss* 

The <>rder1ng of stages may also described In concept-identi- 
fication terms, although the order was originally arrived at 
Intuitively. It Involves the addition of relevant and Irre- 
levant dimensions, which according to Walker and Bourne (17) 
results In added difficulty* Both this study and that of 
Haygood (3) Imply that greater ease In learning 
could have been achieved by Increasing the redundancy of either 
relevant or Irrelevant dimensions or both; hov;ever, such 
cueing" was deemed unnecessary since four or more exemplars 
were available at each stage* 

Another aspect of the research reported here relates to mode 
of presentation. Comparisons between simultaneous and succes- 
sive presentations by Bourne, Goldstein and Link (2), Cahill 
and Hovland (4) and Kates and Yudin (9) Imply ii^hat availability 
of previous exemplars has a positive effect on learning, 
particularly If time for response Is not limited. Thus 
availability (to S at each presentation) of the previous two 
exemplars, characteristic of the simultaneous treatment In 
this study, should be beneficial, especially since Ss were 
allowed as much time per frame as they needed* 
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Materials ai^d Treatments : This report Involves five sequences 
of learning tasks; the f 1 rst Introduces the concept of a 

®s an operator, and the concept of vector 
addition, and has eleven stages* Each stage Is made up of a 
number of exemplars each exemplar having the same number of 
relevant and Irrelevant dimensions; most of the Irrelevant 
dimensions vary from exemplar to exemplar* Each eweraplar 
consists of a problem frame, a student's response frame, and 
an answer frame (Figurel)* The sequences which follow are 
made up In a slroHar manner and cover vector notation, scalar 
multiples, commutativity, and associativity Each stage, or 
set of several exemplars. Is called a "P-ser1es*'* The number 
of exemplars within the series Is generally four, but on PI, 

P2 # P3, and P6 In the first sequence It was necessary to 
provide many more exemplars to bring students to criterion. 
Criterion was two successive correct responses, after which S 
was presented the first exemplar of the next P-serles* Correct 

ness was judged subjectively by both the experimenter and the 
timer* 

Each learning task (1*e* each exemplar) was cast In two 
formats* One Involved only the graphical (or “symbolic’*) 
representation of the task; the other was exactly the same 
except that a relevant wordal task was added. The non-wordal 
treatment was abbreviated ”N“, the wordal, “W“. In the 
first sequence PI, P2, and P3 could be consldet^ed collectively 
a “learning phase", with P4 - Pll the "applications"; how- 
ever, P6 was a new concept (vector addition) , with Its own 
applications, as well as a "transfer task". For full Infor- 
mation on the first sequence, see Appendix B* 

Su bjects ; $s were fifth and sixth graders enrolled In local 
public schools, matched on the basis of Intelligence (Cal- 
ifornia Mental Maturity), reading achievement, and arithmetic 
achievement (California), Matching consisted of selecting 
groups of foyr with similar profiles, and placing one In each 
cell (Sly, MU, MI ), In each cell there were two students 
with IQ greater than 115, and three with IQ less than 115. 
Comparisons between the abovc-115 and the below-115 groups 
(dubbed "A" and "B" respecti vely) were made on the basis of 
two In each group In each cell: the third "B" student In 

each cell had been given a slightly different program due 
to an error which occurred early In the Investigation* 

Le arning Procedure ; Each S, Individually, was shown (by X) 
a frame which stated the learning task* Then S was given 
a similar frame on which to lonstruct his response^ lio 
verbal Instructions were given* Finally, S was shown another 
frame with the correct answer* If S asked a question con- 
cerning the response frame he was asked, "Mould you like to see 
the answer?" If the Question concerned the correctness of 
his answer, S was told, "1*11 let yo:s decide about that." 

The correct answer was removed last, so that the correct 
response was always the last in view. S was then given another 
exemplar of the same task. This continued until the S had 
responded correctly to two tasks In a row: then he was pre- 

sented with the first task In the second stage* 



T 



















5 



1 












V •:>A- 









''■2t:;-f2:: 






Each $ was timed, beginning .when the problem frame was presented 
iand ending when the S completed his response. Most Ss covered 
the first book In one session of about three-gmarters of an 
hoyr. 



There were three scores: penetration, time, and accyracy. 

“Penetration” was the^nymber of exemplars required to reach 
criterion at a given stage; ”t1me” was the mean response time 
per frame In a given stage; “accyracy” was the total of two 
scores, one for length and one for direction (each had a 
maxlmyim of two points). These data were plotted for each set 
of treatments and for each Interaction; two graphs for the 
W-N dimension are given In Figyre 2. 

There were two procedyral treatments. In one, the answer 
frames from the prevloys two tasks were retained within the 
view of the student; In the other, no previous material was 
left In view. This corresponds to treatments described as 
"slrnyl taneoys” and “successive” (abbreviated I and 0 respect- 
ively) In studies of concept .Identification.- 



Testing Procedures : A testing procedure was designed to 

y'teld data compatible with those recorded during learning. 

Each of seven test tasks was cast In four forms, comparable to 
exemplars at each stage In the learning sequences. S res- 
ponded to the first exemplar of each task, one at a time, and 
was shown the correct response to each before going on to the 
next. After S responded to the second of each; In the second 
phase, the order was changed; as before, S was shown the correct 
answer to each task (after responding) before being given the 
next. This was carried on until S had responded to all four 
exemplars of each of the severs tasks. Since S was shown 
the answer In each case, this was a relearning experience as 
well as a conventional test. Scoring was as follows (“C” 
means "correct”, "W" means "wrong"): 



First exemplar: 
Second exemplar: 
Third exemplar: 
Fourth exemplar: 
Score: 



w y w w w.wccc€cccc 
MyyMCcccccrcyyyy 
yyccccyyccyyycwy 
ycwccwcwcwcycwcu 

544324341 3242324 

* "k it it 



Thus, for examplco a student who In answering the four 
exemplars for the first test task got the first wrong and all 
the rest right received a score of ”2”, whereas. If he got the 
first right, the second wrong, and the others right, he 
received a “2” also. In the latter case, the asterisk Indi- 
cates that there was an Inconsistency In his response pattern: 
at least one "W“ Is found following a ”C". This scoring Is 
similar to the scoring of ^pe net rat ^ on s " on the learning stages. 
Inconsistencies were recorded to see whether they furnish an 
additional qualitative criterion for comparing learning among 
groups. 
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Results: 
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A. Sequence I ; Tables 1, 2, and 3 represent the results of 
trend analyses patterned on examples in Edwards (18). 

a. For penetration there is a significant inter- 
action between wordal-non-wordal and stages: 
the curves are significantly different at the 
.05 level. These curves are shown in Figure 
2; differences favor wordal for P1-P3, non- 
wordal thereafter. 

b. For accuracy and time, the wordal and non- 
wordal treatments are significantly different 
at the .005 level (for accuracy curves see 
Figure 2); differences favor non-wordal. 

c. For time, the successive and simultaneous treat- 
ments are also significantly different (.01). 
There is a significant interaction of wordal- 
non-wordal with stages, also of simultaneous- 
successive with stages (.05). Finally stages 
are significantly different for all three 
criteria, at the .005 level. Differences favor 
non-wordal stimuli and successive presentation. 

While there were some hints of interactions with intelligence, 
it was not felt that the sampling procedure was well enough 
defin.ed in this area to merit statistical analysis; an 
example of a potential interaction is given in Figure 3. 
Additional details regarding Sequence I are given in Appendix A. 

B. Sequence !I : Under exemplars-to-criterion , the trend ana- 
llysis again shows the curves for wordal and non-wordal to be 
significantly different (.05); as before, differences favor 
the wordal treatment early in the sequence then non-wordal 
later. However, in this sequence the wordal and non-wordal 
treatments are also different (.05), favoring non-wordal. 
under time, the non-wordal treatment is significantly quicker 
than the wordal (better than .001); there is a weak differ- 
ence between simultaneous and successive, favoring the latter 
(.25). The trend analyses show time differences for all 
treatments and the interaction, (all .01); this favors non- 
wordal and successive respectively. The responses in Sequence 
II were not of a type to yield an accuracy score. 

C. Sequence III : Errors in computation force postponement 
of reporting results for this sequence. 

0. Sequence IV; Under exemplars-to-criterion, there were 
weak effects favoring the non-wordal treatment (.25) and the 
non-wordal -success! ve combination (.25). Time data replicated 
results ill previous sequences. 

E. Sequence V; Under exemplars-to-criterion, there was a 
weak effect favoring the non-wordal treatment (.25), and a 
slightly stronger trend difference favoring non-wordal (.1), 

Time data replicated previous results. There were two stages^ 
which yielded accuracy scores: no significant differences 

resul ted. 
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post "Test : Scores derived according to the process 

described previously, sl^s lar to exemplars-to-crlterlon 
scores in the learning sequences, showed no wordal-non- 
wordal differences either In treatments or In trends. There 
was, however, a surprising difference between simultaneous 
and successive treatments, (.1), favoring successive. 

There was also a difference In frequency of Inconsistencies, 
favoring the successive treatment: this was not tested 

statistically. In respect to time required to respond to 
each task, there was a weak difference between simultaneous 
and successive treatments (.25) favoring successive; all 
trends showed significant differences, favoring non-wordal* 
successive, and their combination (all better than .01). * 

^■Dela yed Poet Test: The scores derived according to the 

process described previously, similar to exemplars-to- 
criterion In learning sequences, showed a weak trend favoring 
the non-wordal group (.25). For a time, a weak trend effect 
was found favoring the non-wordal successive combination (.25). 

Corr elations between Sequences and between Sequence s and 
Test^ in a previous study . data giiggect-ori possibility 
of an optimum tr1a1s-to-cr1ter1on level for post-test per- 
formances, I.e.; It seemed possible that students having 
an intermediate trial-to-criterlon score might show better 
post-test performance than those having low or high scores. 

No evidence of this was found here: all correlations be- 

tween sequences and between sequences and tests show simple 
positive linear-like scatter plots. Sequence-test correla- 
tions increase as one progresses from Sequence I to Sequence V. 

I ^Immediate vs* Delayed Post-Test: 

Tl/ Scores on delayed post-test were generally better than 
corresponding scores on the Immediate post-test, and Ss 
generally took less time. 

(2) On the two test tasks yielding accuracy scores, the 

accuracy of the simultaneous groups decreased while that 
ot the successive groups Increased. 

Discussion : While the addition of a wordal component obvi- 
ously adds to the relevant and Irrelevant dimensions of a 
task, thus making It more complex and time consuming, there 
Is some reason to believe that the information the words con- 
tain should aid the student In solving the task, and there- 
by decrease the number of trials to criterion. That this 
has an element of truth Is attested to by comparative pene- 
trations (I.e. trials to criterion) on the first three 
stages of Sequence I where wordal Ss were lower. On sub- 
sequent stages the non -wordal Ss had the advantage. More- 
over, at Stage 6, where a new concept was Introduced (addition 
of vectors), the non-wordal Ss tended to require fewer 
trials to criterion. A similar early-late difference was 
noted In Sequence II. 
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These results Indicate that previous studies comparing 
pictorial and verbal presentations must be 1nte*^preted 
conservatively. Since the concepts used In those studies 

involved dimensions which have been thoroughly learned 
by Ss previous to the experiment (e.g; the color of wing, 
shape of beak), words may have recalled previous experience 
more effectively than In this study where previously learned 
concepts are not as clearly applicable to the subject matter. 
Words seemed to be of some help during early stages, where 
fundamental relationships were learned,”” 



To compare non-wordal and wordal stimuli, one may regard the 
latter generally as being highly redundant In relevant d1- 
menslons (when well learned by S) and thus capable of pre- 
venting Irrelevant dimensions from controlling responses. 

One may challenge the effectiveness of the particular words 
usid In this study, but results suggested that the superior- 
ity of any given wordal presentation can no longer be consi- 
dered a foregone conclusion. Experience gained In developing 
the wordal and non-wordal components of these frames Indi- 
cates that further Improvement In both, as well as In their 
Interaction, Is to be expected. 



In one sense these data support research Indicating advan- 
® Rul-Eg" approach, since In this study words 
aided learning In early stages; but the non-wordal stimuli 
seemed more effective In later stages. On the other hand, 
the failure of words to assist In the learning of a new 
concept (Stage 6) Implies that the matter Is more complex 
than the simple “51ul-Eg'' formulation admits, whether one 
takes the point of view described above or simply looks on 
the wordal version as a rul-eg process where the responses 
/avj ® words first and then responds to the non-wordal task 
(this was most frequently the procedure, and many Ss failed 
to respond to the non-wordal component on the early tasks 
at a given stage). 



One outcome from Sequence I which was not anticipated was 
the highly significant difference In accuracy of response 
found In both sets of treatments, W-N and I-U, Accuracy, 
«1ke time, seems to be a function of the complexity of the 
stimulus field, rather than of any particular treatment var- 
iable. Incldently, where wordal Ss failed to respond to 
non-wordal components of a task, these tasks were not used 
In computing mean accuracy. 



The overall absence of significant differences between simul- 
taneous and successive treatments In trials to criterion 
(penetration) may be Interpreted as a failure to replicate 
^!lS Yudin and Kates (8) and of Bourne, Goldstein 

'“ 4 * true that the number of subjects Is 

rather- smal 1 , but ample time was allowed for response. Time 
and accuracy data Imply that stimulus complexity Is a more 
powerful factor than reduced memory load, at least In this 
learning situation. 



The Inunedidte post-test results contain several simultan- 
eous-successive comparisons which suggest that the successive 
treatment had some differential effect on the Ss: this 

may reflect the fact that two of the successi ve-wordal 
students had dropped from the experiment. On the other hand, 
the delayed-lmmedlate comparisons for accuracy show a puxzling 
oiff6r6nc6 which would not seoni to ^6© blssed by drop-outs: 
the successive students scores Increased while the simultan- 
eous group s scores decreased. No hypothesis Is offered 
for this effect; It would seem to call for further Investl- 
gatlon with more subjects. It may be that the strong time 
effect, seen all the way through, relates to It. 

The appearance of even weak effects on the post-tests Is 
worthy of some note. The difference In time required to res- 
pond, fav@r1ng non-wordal as well as successive. Is Interest- 
ing since there Is of course no treatment difference for 
the groups on the post-test. This Implies that Ss learned 
to take different amounts of time to respond as a result of 
treatments which during learning required more time; of 
course, there are no data to prove that the two groups did 
not differ In time-to-respond before beginning the experi- 
ment, and while unlikely this possibility should be consl- 
designing future experiments of this type. That 
this difference had largely disappeared by the delayed post» 
test except for a weak wordal-successi ve trend Interaction 
would Imply that the groups did not differ originally In 
this respect. 

The Improvement of scores from Immediate to delayed post- 
test may only reflect familiarity with the test, since the 
nature of the test made It a fairly thorough learning situa- 
tion as well. However, since response to the first exemplar 
of each task wasgiven the greatest weight, there may be 
some remlnl scence-1 1 ke effect as well. 

The nature of feedback here requires some comment. Infor- 
mation regarding errors Is Implicit In the showing of the 
correct response following the response of S. This by no 
means assures strong feedback, however: It was observed that 

many Ss Interpreted the repeated showing of the correct 
response to mean that they had the wrong hypothesis, rahher 
than that they were not sufficiently accurate In their res- 
ponse; this Interferred with the formation of the correct 
concept. Such feedback Is "weak" In the terminology of 
Wallace (18) and thus conducive to hypothesizing and testing. 
The Investigators originally conceived of this feedback 
as a means of shaping "discovery" behavior, as well as of 
maklnq pre-testing an Integral part of the programing pro- 
cess (ordinarily one Is never sure In programing whether one 
has made the task difficult enough). Further attention Is 
being given the feedback dimension, since It seems particu- 
larly Important In working with lower ability Ss. It may 
also be worthwhile In the future to record the time devoted 
by S to Inspecting the correct answer, once he has responded: 
this datum may be or may not be highly correlated with tlme- 

to-respond, and It may be related to the "learning style" 
of S. 
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Summary ; This study suggests that non-wordal sequences can 
be employed advantageously In teaching certain concepts; the 
criteria of trlals-to-crlterloOf time* and accuracy all 
favor non-wordal sequences and In some cases, successive 
treatment as well. 



This study Indicates the feasibility of replicating aspects of 
basic concept formation research In applied subject matter 
areas 9 and suggests that terminology from such research 
can be applied to "practical" teaching to good advantage. 

This study Implies that small-group program-development 
studies which emphasize experimental analysis of behavior 
can be given an experimental-design emphasis without qoinq 
to prohibitively high “W's"; however, results from such a 
study should be taken as suggestive for more rigorous Investi- 
gations by others who concentrate on experimental design 
and comparison of treatments. 



Finally, this study demonstrates that research In curriculum 
design Involving the experimental use of new approaches to 
teaching, stemming from advanced sophisticated subject matter 
frames of reference, can be carried on In conjunction with 
research In learning; Indeed, In the opinion of the Invest- 
igator, It Is Impossible to separate this dimension of 
research from thit of research In learning. In this study, 
the approach to teaching vectors (and In a larger sense to 
teaching algebra) which resulted from our desire to draft 
non-wordal sequences produced a learning sequence which has 
unusually powerful Implications for the more effective 
teaching of algebra at all levels. 
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Tables I, U» III 
Trend Analyses 
Sequence One 








(1) 


Trials to 


Criterion 


Source of 
Variation 


SUN OF 
SQUARES 


d.f . 


HEAN 

SQUARE 


F 


UN 

lU" 

UN X !U 
Error (a) 


.E228 

18.0410 

4.9499 

269.9273 


J 

1 

1 

16 


.2228 

18.0410 

4.9499 

16.8705 


KC694 


Stages 
WN X St. 
lU X St. 

WN X lU X St. 
Error (b) 


1,027.7455 

141.7272 

47.3090 

53.8001 

1,096.8727 


10 

10 

10 

10 

169 


102.7746 

14.1727 

4.7309 

5.3800 

6.8555 


14.9916 *** 
2.0673 * 






(? ) 


Time 




Source of 
Variation 


SUN OF 
SQUARES 


d.f. 


NEAN 

SQUARE 


F 


WN 

lU 

WN X lU 
Error (a) 


24,825.314 

10,213.641 

206.222 

17,939.237 


1 24 

1 10 
1 

16 1 


,825.314 

,213.641 

206.222 

,121.202 


22.142 *** 
9.110 ** 


Stages 
WN X St. 

:u X St. 

WN X lU X St. 
Error (b) 


9,816.610 

3,499.935 

3,110.009 

1,008.829 

21,212.163 


10 

10 

10 

10 

160 


981.661 

349.994 

311.001 

100.883 

132.576 


7.405 *** 
2.640 ** 
2.346 * 






(3) 


Accuracy 




Source of 
Variation 


SUN OF 
SQUARES 


d.f. 


NEAN 

SQUARE 


F 


WN 

lU 

WN X lU 
Error (a) 


10.5603 

.1326 

.0115 

15.9049 


1 

1 

1 

16 


10.5603 

• 1326 

• Oils 
.9941 


10.6230 *** 


Stages 
WN X St. 
lU X St. 

WN X lU X St. 
Error (b) 


35.8053 

4.5517 

2.7274 

3.8025 

55.0028 


10 

10 

10 

10 

160 


3.5805 

.4552 

.2727 

.3803 

.3438 


10.4145 *** 
1.3240 

1.1059 


COOE: .OQS 


** F nnr 
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Tables IV* V 
Trend Analyses 










(1) 


Trials 


to Criterion 


L\> 


Source 


df 


S S 


N S 


F 


i 


m 

lU 

UN X lU 
Error U) 

St. 

UN X St. 

10 X St. 

UN X lU X St. 
Error (b) 
Total 


1 

1 

1 

16 

14 

14 

14 

14 

134 

209 


28.2134 

0.0000 

5.8800 

60.7733 

87.3667 

47.0866 

8.3000 

16.0200 

222.0267 

475.6667 


28.2134 
0.0000 
5.8800 
3.7983 
6.2405 
3.3633 
0.5929 
1 .1443 
1.6569 


7.4279 * 

1.6481 ” j 

3.7664 ** i 

2.0299 * 1 








(2) 


Time 




* 


Source 


df 


S s 


H S 


F 




UN 

10 

UN X 10 
Error (a) 
Stages 
UN X Stages 
10 X Stages 
UN X 10 X St. 
Error (b) 
Total 


1 

1 

1 

16 

14 

14 

14 

14 

134 

209 


74261.3334 

5598.7201 

604.9192 

43764.8270 

67603.6667 

75206.8666 

2103.4799 

71843.14.5 

3484.7063 

344471.6667 


74261.3334 
5598.7201 
604.9192 
2735.3017 
4828.8333 
5371. 919C 
150.2436 
5131.6534 
26.007 


27.1492 ** 
2.0468 " 

185. ** 

206.5 ** 
5.78** 
206.5 ** 




CODE: * .05 


** .01 


'• .25 
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Table VI 






iPT 


Penetration 


Source 


d 


.f 


SS 


MS 


F 


UN 


1 




0.7404 


0.7404 




lU 


1 




10.2912 


10.2912 


3.970K.1) 


HN X lU 


1 




4.4G28 


4.i^628 


1.7216 


ERROR (a) 


14 




36.2913 


2. 5922 




ST 


6 




77.0000 


12.8333 


11.2949 


WN X ST 


6 




S.1096 


0.8518 




W X ST 


6 




4.1838 


0.6973 




UN X lU X 


ST 6 




1.9789 


0.3298 




ERROR (b) 


84 




95.4420 


1.1362 




Total 


125 




235.6000 






Table VII 


















IPT 


Mean 


Time 


Source 


d 


.f 


SS 


MS 


F 


UN 




1 


1225.1520 


1225.1520 


1.0277 . 


ly 




1 


2528.7240 


2528.7240 


2.1212<i9 


UN X ly 




1 


3.1452 


3.1452 




ERROR (a) 




14 


16689.9947 


1192.1425 




ST 




6 


26569.9541 


4428.3307 


193.2360 


UN X ST 




6 


1333.6369 


222.2728 


9.6992>>) 


ly X ST 




6 


825.2399 


137.5400 


6.001X") 


UN X lU X 


ST 


6 


893.9909 


148.9985 


6.501764 


ERROR (b) 




84 


1925.0053 


22.9167 




Total 


125 


51994.8730 
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Table VIU 






OPT 



Penetration 



Source 


d.f. 


SS 


MS 


F 


m 


L 


2.909 


2.909 




lU 


1 


3.7866 


3.7866 




m X ID 


1 


1.1689 


1.1689 




ERROR (a) 


13 


69.7620 


3.059 




ST 


6 


125.1429 


20.8571 


22.14 


WN X ST 


6 


8.0889 


1.3481 


1.431 (.25! 


lU X ST 


6 


1.8218 


.3036 




UN X lU X ST 6 


0.910 


.1520 




ERROR (b| 


78 


73.4650 


.9418 





Total 



118 



287.0551 



Table IK 






DPT Mean Time 



Source 


d.f. 


SS 


MS 


p 1 


UN 


1 


148.3695 


148.3696 




lU 


1 


27.6895 


27.6895 




UN X lU 


1 


291.7937 


291.7931 




ERROR (a) 


13 


6306.1647 


485.0896 




ST. 


6 


26847.3950 


4474.5658 


33.5372 


UN X ST 


6 


820.1523 


136.6921 


1 . 0245 1 


1 lU XST 


6 


383.7609 


63.9602 




UN X lU X ST 


6 


1082.9994 


180.4999 


1.3529 (.25) 


ERROR (b) 


78 


10406.8353 


133.4210 




Total 


118 


46315.1597 
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Figure IV 

COMPARISON IPT - DPT 




TABLE X 

Post»Test Accuracy 

Mean Accuracy on delayed Post-Test minus that on 
Immediate Post-Test. 

WI .11 

m -.85 

NI .29 

NU -.70 

I.e. accuracy decreased for I, Increased for U. 
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APPENDIX A 



Particular Conclusions regarding Treatments In Sequence I i 

N vs . W : The non-wordal treatment Is generally preferable 
according to the three criteria, although the number of 
exemplars required Is lower for the wordal sequence In the 
first three stages. The mean time Is 21.3 seconds eer frame 
less for the non-wordal .treatment (the mean time of the N 
treatment Is 16.5 seconds.). 

I vs. U; Successive presentation saves time; there Is no 
consisteft difference In penetration or accuracy, although 
the simultaneous presentation has the advantage In a majority 
of the series. 

A vs. B ; The above-115 group Is superior on all criteria; the 
time difference Is least. 
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Conclusions regarding Interactions ; 

NW X lU ; NI and WI frequently appear as outer points In the 
penetration distribution (see P2, P5, P6, P9, Pll). While 
relative mean times balance this part, the time graph does 
not show the same symmetry, nor fs this reflected In accuracy 
data except on P9. If one considers the N group only, on 
penetration and accuracy, I Is consistently superior to U 
this seems to reflect more effective use of additional (pre- 
viously presented) Information when words are not Involved. 
Time still favors D, however. 

NW X AB; Considering A alone, the N vs. W comparison Is le:^s 
consistently In favor of N than In the over-all situation. 

The A group, then, benefits more from words than does the 
over-all W group. In penetration, WA Is superior to NA at 
several points; Interestingly, however, this Is balanced by 
a greater time differential, I.e.; WA shows the greatest 
mean time of any group at most stages, especially at P5 and 
P8. Thus while words (for the group) add Information to 
the stimulus, .theyalso require more time for processing. 

lU X AB ; In penetration In the first stages there Is an 1n- 
te resting contrast between lA (low) and IB (high); this 
Is repeated less strikingly at PIO. At these stages It seems 
that only the A-group was able to utilize the additional 
Information In the simultaneous presentation, and that 
the B-group only became confused. In later stages, on the 
other hand. It Is evident that the extra Information aided 
the B grouk since BI has lower penetration than BU on P6, 

P7, P8, P9, and Pll. Thus It would seem that In the confus- 
ion of meeting a new situation, the simultaneous presentation 
added to the problems of adaptation, while subsequently It 
aided learning. 
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Of course, the time comparisons favor 0, but less at certain 
stages (P6,P10,Pn). One Interesting feature of the accuracy 
graph Is found In comparing early and late performance: IB 

for Instance begins low In early frames but Is high on P6, 

P7, P8, low again on P9 and PIO, even on Pll. Such erratic 
behavior Is hard to account for. There are many Instances 
In both accuracy and penetration data of such erratic be- 
havior: some Investigation Is suggested Into this matter. 

4 

Discussion : Inclusion of wordal stimuli is analagous to the 
addition of relevant and Irrelevant dimensions; this Inter- 
feres with learning, os demonstrated by Walker and Bourne (17), 
and confirmed Incidentally, by others. The NW X AB Inter- 
actions Imply that these added dimensions are redundant for 
the A group, another way of saying that this group “understood" 
the words. The NW X AB Interaction suggests also that the 
N approach Is preferable for use with heterogeneous groups, 
since A vs. B differences are minimized. 

It Is Interesting to compare the W and N modes with programing 
methods dubbed “Rul-Eg“ and the like. N would assumedly be 
described as Eg-Eg-Eg- . . ., while the W would combine both 
Rul and Eg at each step (observation of Ss Indicate that 
they were following a Rul-Eg-Eg-Eg-. . . process In fact, 
since they did not attend markedly to the wordal component 
after the first exemplar). 

The Intuitive non-wordal approaches of Beberman and Suppes 
seem to have been validated In part by this experiment. 
Subjective observations during this and previous projects 
Indicate also that the students have little troubW taking 
up where they have left off In the sequence In spite of days 
or weeks between sessions: research reported by Postman (11) 

Implies that relatively meaningless material (represented 
here by the N treatment) Is retained well once learned. 



APPEMDIX B 



Plans for a 

Follow-Up 

Investigation 



NextSte£s: A new investigation was designed and stimulus 

materials drafted to follow up various dimensions of the 
present one. This Is described In some detail here, because 
It represents an Important outcome of this Investigation and 
defines operationally v/hat we consider to be Its* strong and 
weak points. 



Subjects; Fifth grade students will be screened for pre»#1ous 
learning of the criterion task through a pre-test. Several 
treatment groups will be matched In that their frequency 
distributions (using pre-testing data) are similar. 

Materials, Learning, and Procedure ; An ordered sequence of 
wordless concept formation tasks related to the subject oF 
vector spaces will be used; this will lead to addition and 
subtraction of directed numbers, assumedly using addition 
and subtraction of vectors as the covert mediator for this. 

In some of the treatments, wordal tasks (designed to communi- 
cate concepts or processes similar to those In the non-wordal 
tasks) will be presented either before or after the corres- 
ponding non-wordal ones. Ss will be required to attempt all 
tasks regardless of their performance on the previous one 
(In contrast to the present study In which subjects passed 
on to the next stage after two correct responses). Both 
non-wordal and wordal tasks will require constructed responses 
Feedback on non-wordal tasks will be obtained by having 
the student superimpose the correct response on his own 
response sheet; since the sheets are semi-transparent, the 
two can be compared. To facilitate this superposition pro- 
ess, students will proceed through the text from “back" to 
"front". Feedback on wordal tasks will consist of the res- 
ponse words, typed under the blank space; these also can 
be superimposed on the student answer frame. 



Treatments and Experimental Procedure; Each concept forma* 
tion task will require each $ to construct a response to 
each of twelve exemplars, regardless of correctness of res- 
ponse. within the twelve, there will be four modes. Letting 
N represent non-wordal tasks and W represent wordal tasks, 
the four modes will be as follows; 



NNNNNNNNNNNN 

UUWUNNNNNNNN 
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NNNNWk'NNNNNN 



(symbolized "N12) 
(symbolized "M4N8") 
(symbolized "W2N10") 
(symbolized "N4M2N6") 



The order within the series or twelve of less non-wordal 
exemplars will vary from student to student, since exemplars 
have different difficulties and since we have not analyzed 
and classified these difficulties as yet. Considering each 
sequence of twelve as one stage of the program, and using 
Roman numerals for stages, one can present the overall se- 
quence as follows (In the M4N8 mode): 

I (VJ4N8), II (M4N8), III(Vi4N8), etc. 



w 







T® 1^?? progression qua subject matter^ staje 

I win treat the vector as operating on a point, Stage II 
win present vector addition (two vectors operating on 
one point), etc. 

The stages are ordered Intuitively. It Is not a trivial 
question whether Stage II benefits from the learning of Stage 
I. This question of proactive facilitation (or transfer) 
is one which should be investigated. To seme extent, how- 
ever, the procedure Is "helrarchical", leading from the con- 
cept of a vector as an operator through vector addition. 
Inverse, scalar multiples, and ordered pairs, to addition of 

° abstraction of the addition of scalar 

multiples of a single arbitrarily chosen vector, e.g.; 

3x + «2x = X leads to 3 + -2 ■ . 



Scores will be derived for each S for each stage as follows; 

P equals penetration, the number of responses 
preceding the first correct response. 

C equals consistency, the number of times an Incorrect 
response follows a correct response (high 
C means low consistency). 

T equals time, the total time on each stage. 

A equals accuracy of response where applicable. 

Ss will fill In a time sheet at the end of each stage to give 
Tu ^ will be recorded following the experimental session. 

Thus P,C, and T scores will be derived for each stage for 
each students ^ 

? l^e administered prior to the experiment; 

It will Include pre-requisite tasks (matching to sample of 
geometric designs similar to the non-wordal tasks In the 
experimental sequence, also addition and subtraction of non- 
dlrected numbers) and target tasks (adding and subtracting 
vectors, adding and subtraction directed numbers, also 
transfer tasks relating to these two areas). Post-tests will 
be administered covering the same topics with less emphasis 
on prerequisite behaviors. One post-test will be delayed 
two days, the other two months. The tests will be concept- 
attainment tasks similar to those to be used in the program; 
four tasks at the same level of difficulty will constitute 

there will be at least five sets. The tasks 
within a set will be scattered randomly through the test. 

Thus for set A (e.g. adding two vectors) there will be four 
exemplars, al , a2, a3, a4; similarly for B and C and others. 

A simplified version of the test consisting of only three 
sets will then be ordered as follows: 

al, bl, a2, cl, b2, c2, a3, c3, b3, c4, a4, 

From such a test one can take the first of each set and score 
performance as on a conventional test; one can also get a 
score# One adcHtlonal test will be ysed: this 
will consist of a series of one hundred problems in adding 
directed numbers; it will be designed to explore the possibility 
o that covert mediation can be extinguished in such a sit- 



uatlon if It is not explicitly reinforced. The explicit 
orrvectorSrfrhiLil” 5fc given problems In adding multiples 

To summarize the treatments, they will be as follows; 

(a) N12, W4N8, W2N10, and N4W2N6 constitute four treatments. 

reinforcement of the mediator vs. no such rein- 
vp„two other groups; these might be called 
R and E , for 'reinforcement" and "extinction". 

Hypotheses: There will be several null^hypotheses available; 



( 1 ) 



( 2 ) 

(3) 

(4) 

(5) 

( 6 ) 



penetrations for the non-wordal components of 
the four groups are not significantly different as 

SSplt^^bJ^sJa^es) a»»alysis (analysis of variance 

The consistencies are not significantly different. 

The times are not significantly different. 

The accuracies are not significantly different. 

The reinforcement group is not significantly different 
from the extinction group in relation to errors on the 
test on adding directed numbers. 

stage does not cause 

a significant difference in. penetration , consistency, 
time, or accuracy. 



